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(54) RECOGNIZING METHOD OF STEP OR THE LIKE OF MOVING BODY 
(57)Abstract: 

PURPOSE: To easily recognize an obstacle such as a step or the like and to 
obtain the positional information of the obstacle by treating an image obtained by 
a visual sensor through a binary process, forming a binary image, and obtaining 
the area of the image of one of the two values. 

CONSTITUTION: An image processing unit binarizes an image obtained from a 
visual sensor thereby to obtain a binary image and extracts the white area. Then, 
the longest part, a starting point and an ending point of the longest part in the 
white area are obtained for every scanning line in an image memory, so that a 
quadrilateral is formed. It is subsequently detected whether the white parts are 
connected each other. The starting line and tire ending line of the connected 



parts are stored and the area is calculated. The above process is carried out for 
each diagram output from two visual sensors, thereby to obtain the right and left 
diagrams. Then, the right and left quadrilaterals symmetric to each other are 
determined. The coordinates of four end points of the right, and left 
quadrilaterals determined to correspond to each other are compared. It is 
detected whether the distance of the points is within the range smaller than a 
predetermined value. The trigonometrical measurement is conducted for each 
end point of the pair showing the distance smaller than the predetermined value. 
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CLAIMS 
[Claim(s)] 

[Claim 1] In the mobile which refers to the information which has one or more 
visual sensors, and is acquired, performs migration control, and moves a. by 
predetermined binary-ized processing to the image obtained from said visual 
sensor Perform said binary-ized processing about the external world containing 
a polyhedron in which almost ail the pixels within each side have a different 
output value from the pixel within the border area which classifies those fields, 
and a background, and a binary image is obtained, b. The recognition approach 



of the polyhedron of the mobile which consists of what a polyhedron is 
recognized for based on the area for which asked for the area in an image about 
either of binary, and it c. Asked. 

[Claim 2] In the mobile which refers to the information which has one or more 
visual sensors, and is acquired, performs migration control, and moves a. by 
predetermined binary-ized processing to the image obtained from said visual 
sensor Perform said binary-ized processing about the external world including a 
stairway in which almost all the pixels of each stage have a different output value 
from the pixel within the border area which classifies those fields, and a 
background, and a binary image is obtained, b. The recognition approach of the 
stairway of the mobile which consists of what the three-dimension location of a 
stairway is computed for from the predetermined part for which scanned x 
directions and from y in the axis of coordinates about the binary image, extracted 
the geometric description, and asked for the predetermined part, and it c. Asked. 
[Claim 3] The recognition approach of the stairway of the mobile given in claim 
dyadic characterized by computing said three-dimension location by determining 
corresponding points for every stage of a stairway. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Industrial Application] This invention relates to what more specifically 
recognizes the body which projects from road surfaces, such as a stairway, in 
the mobile robot which does stereoscopic vision of the external world and moves 
at a high speed about the recognition approaches, such as a stairway of a 
mobile, and acquired positional information. 
[0002] 

[Description of the Prior Art] Recently, the mobile robot of various autonomous 
molds, such as a leg formula, a wheel mold, and a crawler mold, is proposed. In 
order to move such a robot, the technique to which a predetermined path is 
moved according to the migration pattern set up beforehand, and the technique 
to which make a mobile robot have the visual sensor which recognizes the 
external world, make a robot recognize and judge a surrounding situation, and it 
is made to move can be considered. When taking the former technique, it is 
necessary to prepare exact positional information, such as map information, 
beforehand. When taking the latter technique, instead of becoming unnecessary, 
such positional information must recognize promptly itself bodies which project 



from a level road surface, such as a stairway, and must acquire the positional 
information. As a latter conventional technique, the thing given [ for example, ] in 
a Provisional-Publication-No. 59-No. 79377 official report is known. The image 
was obtained in a location which is different, having and moving only one visual 
sensor in this example, binary-ized processing was performed, and the width of 
face of a stairway etc. is measured. 
[0003] 

[Problem(s) to be Solved by the Invention] Although the chief aim of measuring 
the major characteristics on the assumption that the recognition of the existence 
of a stairway itself does not perform the above-mentioned conventional 
technique but a stairway exists is carried out, when recognizing the external 
world generally, what an object is and specifying need to be equipped with the 
hardware of dedication rather than they need to be [ therefore ] easy, and they 
need to perform complicated image processings, such as space differential, also 
for extracting the profile of an object. 

[0004] Therefore, the object of this invention can recognize the obstruction from 
level road surfaces, such as a stairway, simply, can acquire that positional 
information, and is to offer the recognition approaches, such as a stairway of the 
mobile which can be easily built also on a common computing system, without 
needing especially the hardware of dedication etc. 



[0005] 

[Means for Solving the Problem] In the mobile which refers to the information 
which has one or more visual sensors, and is acquired, performs migration 
control, and moves as this invention is shown for example, in claim 1 term, in 
order to solve the above-mentioned technical problem By predetermined 
binary-ized processing to the image obtained from said visual sensor Perform 
said binary-ized processing about the external world containing a polyhedron in 
which almost all the pixels within each side have a different output value from the 
pixel within the border area which classifies those fields, and a background, and 
a binary image is obtained. It constituted so that it might consist of recognizing a 
polyhedron based on the area for which asked for the area in an image about 
either of binary, and it asked. 
[0006] 

[Function] Since a polyhedron is recognized based on the area of a binary image, 
exact positional information, such as map information which the configuration 
was simple, and did not need the hardware of dedication etc., and was made 
beforehand, is not needed. Consequently, it becomes possible to discover the 
stairway only by directing moving trucking including a stairway roughly, and to go 
up and down by the work environment of mobiles, such as works and an 
administration building. In addition, in such restrictive work environment, it does 



not very become trouble to give sufficiently big lightness to the top face of the 

polyhedron of a stairway etc. to a background. 

[0007] 

[Example] Hereafter, taking the case of a 2-pair-of-shoes walk leg formula 
mobile robot, the example of this invention is explained as a mobile. Drawing 1 is 
explanation skeleton drawing showing the robot 1 on the whole, and equips the 
leg of each right and left with six joints (shaft) (each joint (shaft) is illustrated with 
the electric motor which drives it for the facilities of an understanding). To the 
order from a top, the joints (shaft) of these six individuals are the joints 10R and 
10L (right-hand side is set to R and left-hand side is set to L.) for leg winding of 
the waist (shaft). Below The same joints 12R and 12L of the pitch direction (x 
directions) of the waist (shaft), The joints (shaft) 14R and 14L of this roll direction 
(the direction of y), the joints 16R and 16L of the pitch direction of a knee region 
(shaft), While being the joints (shaft) 18R and 18L of the pitch direction of a 
guide-peg neck, and the joints (shaft) 20R and 20L of this roll direction and 
attaching Feet 22R and 22L in the lower part Idiosoma (base) 24 is formed in the 
most significant, and the control unit 26 which consists of a microcomputer is 
stored in the interior. 

[0008] In the above, a hip joint consists of joint (shaft) 10R (L), 12R (L), and 14R 
(L). Moreover, an ankle joint While consisting of joint (shaft) 18R (L) and 20R (L), 



a leg link is being able to give six degrees of freedom about a guide peg on 
either side, respectively, and driving these 6x2=12 piece joints (shaft) at a 
respectively proper include angle during a walk. The movement toward a 
request can be given to the whole guide peg, and it is constituted so that 
three-dimension space can be walked to arbitration. In addition, it is the thigh 
links 28R and 28L between a hip joint and a knee joint, and is connected by the 
leg links 30R and 30L between a knee joint and an ankle joint. Although these 
joints consist of the electric motors and the reducers which double the power 
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that output mainly described previously like, since that detail is given to the 
application (Japanese Patent Application No. No. 324218 [ one to ], 
JP, 3-1 84782, A) which these people proposed previously and it is not just going 
to make it in itself into the summary of this invention, the explanation beyond this 
is omitted. 

[0009] Here, two image sensors 36 are fixed on the plate 34 which equipped with 
rigidity the idiosoma 24 of the robot 1 which shows drawing 1 . Image sensors 36 
consist of a CCD (solid-state image component) camera equipped with a 
well-known light sensing portion and the are recording section, and the output is 
sent to the image-processing unit 38 which consists of a microcomputer. The 
image-processing unit 38 is equipped with the image memory which consists of 
a pixel of **** 512x512 shown in drawing 2 . The plate 34 is attached on the shaft 



40, and image sensors 36 constitute' it so that a shaft 40 may be rotated through 
the device which does not move onto a plate 34 and which is not illustrated 
according to the command of a control unit 26 and image sensors 36 can be 
rocked to y shaft orientations in drawing 1 , while being firmly fixed like. 
Moreover, the robot 1 which shows drawing 1 minds a foot. It has the tilt-angle 
sensor (not shown) which detects whenever [ tilt-angle / of the idiosoma 24 to 
the encoder 46 and road surface which detect 6 axial-tension sensor 44 which 
detects the force component of x, y, and the direction of z transmitted to a robot, 
and the moment component of the circumference of the direction, and the 
include angle of each joint / (**) ]. A control unit 24 acquires vision information 
from image sensors 22, computes whenever [ target joint angle (**) ] on real time 
while it acquires the information about a robot's position in response to those 
outputs, and it controls and walks desired value around each joint. 
[0010] Since it is in the summary of this invention recognizing projections, such 
as a stairway, in the mobile robot which acquires an inner community and 
external world information and walks autonomously, a focus is set and explained 
to that point below. In addition, in this invention, a stairway plans ******** shown 
in drawing 3 . Looking down, when a stairway 50 consists of three steps, the 
height is set up quite lower than the location of the image sensors 36 when a 
robot 1 stands straight and a robot 1 approaches near the possible That is, while 



setting it as the appearance in which top-face 50a of each stage is not hidden 
from the field of view of a robot's 1 image sensors 36 in the stage under it, the 
top-face 50a is painted white, and gives sufficiently big lightness to the 
background. Moreover, it trims with the black tape 52 with narrow width of face in 
the edge of top-face 50a. In addition, wall surface 50b is taken as as [ ground J. 
[001 1] Drawing 4 is whole PAD (Problem Analysis Diagram) drawing (structuring 
flow chart) showing the stairway recognition technique, and shows actuation of 
the above mentioned image-processing unit 38. In this drawing, a white field is 
first extracted in S1 . Drawing 5 is the subchart. 

[0012] If it explains with reference to drawing 5 , in S10, binary-ized processing 
will be performed first. That is, a threshold is determined so that top-face 50a of 
each stage of a stairway 50 and a background may be separated to a 
subject-copy image as shown in drawing 6 , and the **** image which performs 
binary-ization and is shown in drawing 7 is obtained. The decision of a threshold 
is made by proper technique. Subsequently, in the image memory shown in 
drawing 2 , the longest section, and a start point and an ending point of the white 
line section are searched for for every scan line by S12. A display of the white 
line section for which it asked obtains a quadrilateral as shown in drawing 8 . 
Then, it investigates whether the white line section for which it asked by S14 is 
connected, the first line of a part and the line of an end which are connected are 



memorized, and it asks for the area. Subsequently, by S16, the white part for 
which it asked now is sorted, and area rearranges into descending. As this 
shows drawing 3 , it is for equipping with a lower stage matching by triangulation 
described later using it since area should become large compared with the upper 
stage at the time of **** about the stairway 50. Then, the part of under an area 
predetermined by S18 is deleted, and deletes Noises A and B (shown in drawing 
8 ). Then, it asks for the vertical edge of the white section which remained by 
S20. 

[0013] If it returns to the PAD diagram of drawing 4 , the class of quadrilateral will 
be continuously distinguished by S2, and the endpoint will be extracted by S3. In 
addition, a "endpoint" is used here as what means the location of the corner of a 
quadrilateral. 

[0014] Drawing 9 is the subchart and searches S100 for a disappearance part 
first. That is, since the robot of a leg formula was equipped with image sensors 
36 and each stage may interfere as are shown in drawing 10 depending on a 
robot's position, and it may be inclined and reflected and is then shown in 
drawing 1 1 , if it investigates whether there is any white part into the part of a line 
when in contact with the white line section of the line of the beginning of a white 
field part and is in it, as shown in drawing 12 , the part will be added to a lower 
white field. Furthermore, if it investigates whether there is any white line section 



connected with the lower white line section in the line on it, it exists in it and it 
does not add and exist in a white field, retrieval is closed and let the line be the 
line of a new white start of region. Moreover, if it investigates whether there is 
any white part into the part of the line of the bottom which is in contact with the 
white line section of the line of a white end-of-region rate and is in it also about 
the part of an end, the part will be added to the upper white field. Furthermore, 
adding to a white field, if it investigates whether there is any white line section 
connected with the upper white line section in the line under it and exists in it, 
retrieval is continued, and if it does not exist, retrieval is closed and let the line be 
the line of a new white end-of-region rate. 

[0015] Then, the distance between the points which progressed to S102, 
searched for the point that the max, the minimum value, etc. of x were obtained 
from the start point and the ending point of the white line section, and were 
searched for by S104 is calculated, and it asks for the correlation of each point 
from the distance by S106. That is, the value shown below using the start of 
region and line of an end, the beginning of the white line of each line with which 
the white field has ridden, and an end about the white field which was registered 
by the activity till then, and which continued two-dimensional is calculated. In 
addition, in the screen of drawing 2 , the right makes the straight line of + a x axis 
on the top line, and let the straight line prolonged from on at the left end of a 



screen to down be the y-axis. x Thus, y It finishes with the beginning of each 
white line contained to one white field when a shaft is decided, and they are x of 
the beginning of the white line section and the line of an end, and y. It is related 
with a coordinate and they are x, y, x+y, and x-y. The coordinate which gives 
max and min is searched for. x which was able to be found here, y, x+y, and x-y 
The location and coordinate which gives max and the minimum value are set as 
follows. 

xy coordinate of the maximum of x : max x = max xx and max xy xy coordinate of 
the minimum value of x : mix x = (min xx, min xy) xy coordinate of the maximum 
of y : max y = (max yx, max yy) xy coordinate of the minimum value of y : min y = 
(min yx) min yy xy coordinate of the maximum of x+y : [ max ] x+y = () [ max 
xpyx, ] [ max ] xpyy xy coordinate of the minimum value of x+y : [ min ] xy 
coordinate of the maximum of x+y =(min xpyx, min xpyy) x-y: max x-y= (max 
xmyx, max xmyy) xy coordinate of the minimum value of x-y: min x-y = (min 
xmyx, min xmyy) The above It is shown in drawing 13 . 

[0016] The following eight characteristic quantity is further computed from the 
eight focus for which it asked in the top. 

Top Right =(min yx - max xmyx)2 +(min yy - max xmyy)2 Top Left =(min yx - min 
xpyx)2 +(min yy - min xpyy)2 Bottom Right=(max yx - max xpyx)2 +(max yy - 
max xpyy)2 Bottom Left =(max yx - min xmyx)2 +(max yy - min xmyy)2 Max Up 



=(maxxx-max xmyx 2+(maxxy-max xmyy) 2 Max Down = (max xx-max xpyx) 
2+(max xy-max xpyy) 2 Min Up = minxx-min xpyx 2+(min xy-min xpyy) 2 Min 
Down = (min xx-min xmyx) 2+(min xy-min xmyy) 2 In the above Although max, 
min, up, and down define top, bottom, left, and right about the y-axis about a x 
axis Eight characteristic quantity which the top defined is x defined before that, y, 
x+y, and x-y. The distance between the position coordinates which give max and 
the minimum value is shown. These serve as a contact of the quadrilateral in 
which the direction vector on an image was able to be found in four quadrants (1 
0) from top-face 50a of each stage of the straight-line group of (0, 1), (1 , 1), and 
(1, -1), and a stairway, respectively. Although the distance between this contact 
takes various values, the value near 0, i.e., two contacts, is dramatically near, or 
when the same, being settled in an include angle with the direction of two sides 
in that contact in agreement is shown like drawing 23 from drawing 14 . When 
the aspect ratio of an image is 1 to 1 , the include angle which is two sides and to 
make turns into less than 135 degrees. For the radii drawn on the side with 
which the quadrilateral is in contact in the point that two straight lines cross, by 
drawing 23 from drawing 14 , the case of each characteristic quantity, for 
example, drawing 14 , is Top Right. When taking the value of 0, the range where 
the two sides exist is shown. From this relation, by combining the case of 
drawing 23 from drawing 14 , also when the include angle of two sides to make 



is narrower, it can be found. For example, in the case of drawing 22 of Top Right 
=0 and Top Left=0, the existing range of two sides becomes less than 90 
degrees of the contact bottom. It is a combination not only eight characteristic 
quantity but new when searching for the still narrower include angle like the 
after-mentioned x, y, x+y, and x-y What is necessary is just to select out of the 
position coordinate which gives max and the minimum value. 
[0017] Then, in S108, it distinguishes whether a quadrilateral is a trapezoid or it 
is a rhombus from the correlation of each point. Since the obtained quadrilateral 
can be classified according to the following rules when the robot 1 which shows 
drawing 1 overlooks a stairway 50 if it explains concretely, it distinguishes 
according to it. In addition, for the extract of the endpoint mentioned later etc., 
this activity specifies what kind of form the quadrilateral for which it asked is, and 
does that activity easy. 

(a) Trapezoid ( drawing 24 ) 

Min Down<delta And Max Down<delta And (Bottom LefKdelta or Bottom 
Right<delta) Or |min xpyy-max xmyy|<epsilon and — if it |min xmyy-max 
xpyy|<epsilon becomes — trapezoid. In addition, delta, epsilon is taken as a 
forward comparatively small integer. 

(b) Lower left upper right acute-angle quadrilateral ( drawing 25 ) 

the upper conditions of (a) - not filling - Max Up<delta and Top Right - <delta 



And Min Down<delta and - if it Bottom Left <delta becomes lower left upper 
right acute-angle quadrilateral. 

(c) Upper left lower right acute angle ( drawing 26 ) 

the conditions of (a) and (b) — not filling - Min Up<delta And Top Left<delta and 
BottomRight — <delta and — if it becomes Max Down<delta — upper left lower 
right acute-angle quadrilateral. 

(d) A right acute angle ( drawing 27 ) or a left acute angle ( drawing 28 ) 

the conditions of (a), (b), and (c) - not filling - Min Up<delta And Min 
Down<delta or Max Up<delta and — if it becomes Max Down<delta — a right 
acute-angle quadrilateral or left acute-angle quadrilateral. 

(e) In addition, when not fulfilling the conditions of (a), (b), (c), and (d), they are a 
right dip quadrilateral or a left dip quadrilateral. 

[0018] Then, the endpoint of a quadrilateral is extracted by S110. Supposing it 
decides a coordinate like drawing 29 to the location of an endpoint here, the 
location of each endpoint can be determined as follows to the class of 
distinguished quadrilateral. 

(a) A trapezoid ( drawing 24 ) case (trx, try) = = (brx (min xpyx, min xpyy), bry) = 
(blx (max xpyx, max xpyy), bly) = (tlx (max xmyx, max xmyy), tly) () [ min ] In the 
case of xmyx and a min xmyy(b) lower left upper right acute angle ( drawing 25 ) 
(trx, try) = (tlx (max xmyx, max xmyy), tly) = (brx (min xpyx, min xpyy), bry) The 



case (trx, try) of = ((min xmyx, min xmyy) c) upper left lower right acute angle 
( drawing 26 ) (blx (max xpyx, max xpyy), bly) = = (tlx (max xmyx, max xmyy), tly) 
= () min xpyx and min xpyy (brx, bry) = = in the case of ((min xmyx, min xmyy) d) 
right acute angle ( drawing 27 ) or a left acute angle ( drawing 28 ), the Rika 
upper left checks [ the upper right ] Rika first (blx (max xpyx, max xpyy), bly). 
That is, the line number of a certain white start of region is set to St, and it is Line 
i. It is Min about the beginning of a white line. It is Max about [i] and an end. It is 
Max when referred to as [i]. [St+alpha]-Max [St] < Min[St]-Min [St+alpha] 
It becomes a ************ upward slant to the right, otherwise, a left riser (positive 
integer which sets up alpha suitably in addition). 

If it is an upward slant to the right (trx, try), it is = (). [ min ] yx and min yy (tlx, tly) 
= (brx (min xx, min xy), bry) = (blx (max xx, max yy), bly) = If it is a left (max yx, 
max yy) riser (trx, try), it is = (tlx (max xx, max xy), tly) = (brx (min yx, min yy), 
bry) = (max yx). max yy(blx, bly) = -- ((min xx, min xy) e) - in addition to this 
(right dip ( drawing 30 ), left dip ( drawing 31 )) - 

After performing the same check, If it is an upward slant to the right (trx, try), it is 
= (). [ min ] Although it is yx and min yy(tlx, tly) = (brx (min xx, min xy), bry) = (blx 
(max xx, max xy), bly) = (max yx, max yy) Min Down<delta Or Bottom Left <delta 
or Top Right <delta And Bottom Left <delta And if it becomes Max Down<delta 
(tlx, tly), it will consider as = (min xpyx, min xpyy). Moreover, it considers as = (tlx 



(max xmyx, max xmyy), tly) = (min xpyx, min xpyy) a certain case (trx, try) more 
than a certain amount of [ the die length of the white line section of the line of 
beginning ] die length (for example, 10 dots). It considers as = (blx (max xpyx, 
max xpyy), bly) = (min xmyx, min xmyy) a certain case (brx, bry) more than a 
certain amount of [ the die length of the white line section of the line of an end ] 
die length (for example, 10 dots). 

When the lower left is ** (trx, try) = (tlx (max xx, max xy), tly) it is Max 
Down<delta although it is = (brx (min yx, min yy), bry) = (blx (max yx, max yy), 
bly) = (min xx, min xy). Or Bottom Right<delta or Top Left<delta And Bottom 
Right<delta And if it becomes Min Down<delta (trx, try), it will consider as = (max 
xmyx, max xmyy). Moreover, it considers as = (tlx (max xmyx, max xmyy), tly) = 
(min xpyx, min xpyy) a certain case (trx, try) more than a certain amount of [ the 
die length of the white line section of the line of beginning ] die length (for 
example, 10 dots). It considers as = (blx (max xpyx, max xpyy), bly) = (min xmyx, 
min xmyy) a certain case (brx, bry) more than a certain amount of [ the die length 
of the white line section of the line of an end ] die length (for example, 10 dots). 
[0019] If it returns to the whole drawing 3 PAD diagram again, the parallelism of 
each stage will be checked about the quadrilateral continuously obtained by S4. 
Namely, max x of the graphic form of each stage (min x) Underline which is 
made to continue and is obtained (top line) It compares and judges whether it is 



parallel to mutual beyond a predetermined value. Since each stage is essentially 
parallel, the stage which is not parallel is deleted from data. It can judge whether 
it is what has the unsuitable graphic form which the noise mixed and acquired by 
this. 

[0020] After acquiring a graphic form on either side as performed the above 
processing about the graphic form which two image sensors 36 output, 
respectively and shown in drawing 32 , the quadrilateral which corresponds by 
right and left by S5 is determined. That is, it asks for the center-of-gravity 
location of the endpoint for which it asked previously about all quadrilaterals on 
either side first, and sorts by the Y coordinate of the center of gravity 
(rearrangement). Subsequently, a four-side each form on either side is matched 
with the sorted sequence. In that case, it chooses as the Y coordinate of the 
center of gravity of a quadrilateral considered to correspond is approaching 
below the predetermined value. In addition, when a corresponding quadrilateral 
does not exist, it is regarded as what was not obtained in a noise etc., and it is 
not used by triangulation of the stereoscopic vision which describes the 
quadrilateral later (the graphic form detected last time may be used). 
[0021] Then, the Y coordinate of four endpoints of the quadrilateral on either side- 
judged to correspond to S6 spontaneously is compared, respectively, whether 
the distance is in the range under of a predetermined value judges, and 
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triangulation is performed to the endpoint of the affirmed group. In addition, what 
distance left beyond the predetermined value does not regard it as an endpoint 
[ / for incorrect measurement prevention ], and is not used by location survey. 
Moreover, as shown in each endpoint at drawing 32 , the number is given to the 
clockwise rotation from the left near side, and matching is made easy. A 
triangulation method is shown in drawing 33 . This technique itself is well-known 
and it asks for x of the target point (endpoint) L, and a y-coordinate using 
triangular parallelism. Parallax XI and Xr can be acquired by the ability making 
the distance between cameras of 2d, and a focal distance f into known, and a 
target coordinate can be searched for by = (x y) (d(XI+Xr)/(XI-Xr), 2fd/(XI-Xr)). In 
addition, although this formula is restricted when the optical axis of a lens on 
either side is parallel, and proper amendment is usually needed from congestion 
etc., since the triangulation itself is not just going to consider as the summary of 
this invention, detailed explanation is omitted. 

[0022] Then, it changes and finishes with the position coordinate of a request of 
the position coordinate acquired by progressing to S7. 

[0023] Since this example was constituted like the above, a stairway can be 
recognized promptly and that position coordinate can be acquired. Since it 
asked for the corresponding points of the right-and-left image of stereoscopic 
vision using the property of a stairway on that occasion, though it is simple and is 



the technique of not needing the hardware of dedication, either, the positional 
information of a stairway can be acquired easily and promptly. If only a robot 
puts a stairway into a visual field, he can compute three-dimension positional 
information with an exact stairway at any time, and does not need exact 
positional information, such as map information made beforehand. It becomes 
possible from this property to discover that stairway only by directing moving 
trucking including a stairway to a robot roughly, and to go up and down in works, 
an administration building, etc. In addition, when limiting a robot's migration 
environment to this appearance in works, an administration building, etc., it is not 
very troublesome to make lightness of the top face of a stairway larger than a 
background. In addition, it may replace with paint and lighting may be used. 
[0024] moreover, the above-mentioned example - setting - Top Right etc. - 
although eight characteristic quantity was used, it is also possible by making 
characteristic quantity increase further to identify the configuration beyond a 
five-side form. Although the stairway was taken for the example in the semantics, 
it is not restricted to it and can apply to all the polyhedrons. 
[0025] Moreover, a field including the endpoint of the four-side each form which 
stated by S4 of drawing 4 and was computed by triangulation also about the 
parallelism check is considered, and as long as the field is not parallel to a floor 
line, you may make it delete from registration. Moreover, a robot's 1 grade may 



be computed based on the direction of the field which a four-side each form 
makes, without considering that those quadrilaterals are the stages of a stairway 
and equipping a robot 1 with a dip sensor, when there are two or more parallel 
quadrilaterals. 

[0026] Furthermore, although explained taking the case of the leg formula 
mobile robot of a 2-pair-of-shoes walk as an example, it is applicable to the 
uninhabited transit vehicle which is not a robot further while carrying out 
appropriate [ of this invention ] also to robots, such as a wheel mold and a 
crawler mold. 
[0027] 

[Effect of the Invention] In the mobile which claim 1 term refers to the information 
which has one or more visual sensors, and is acquired, performs migration 
control, and moves By predetermined binary-ized processing to the image 
obtained from said visual sensor Perform said binary-ized processing about the 
external world containing a polyhedron in which almost all the pixels within each 
side have a different output value from the pixel within the border area which 
classifies those fields, and a background, and a binary image is obtained. Since 
it constituted so that it might consist of recognizing a polyhedron based on the 
area for which asked for the area in an image about either of binary, and it asked, 
it is a simple configuration and a polyhedron can be recognized, without needing 



the hardware of dedication etc. 

[0028] In the mobile which claim 2 term refers to the information which has one 
or more visual sensors, and is acquired, performs migration control, and moves 
By predetermined binary-ized processing to the image obtained from said visual 
sensor Perform said binary-ized processing about the external world including a 
stairway in which almost all the pixels of each stage have a different output value 

» 

from the pixel within the border area which classifies those fields, and a 
background, and a binary image is obtained. Since it constituted so that it might 
consist of computing the three-dimension location of a stairway from the 
predetermined part for which scanned x directions and from y in the axis of 
coordinates about the binary image, extracted the geometric description, and 
asked for the predetermined part, and it asked If only it is a simple configuration, 
and it does not need the hardware of dedication etc. but it puts a stairway into a 
visual field, the three-dimension position coordinate of a stairway can be 
computed at any time, and exact positional information, such as map information 
made beforehand, is not needed. It becomes possible to discover the stairway 
only by directing roughly the moving trucking which includes a stairway in a 
mobile, and to go up and down by this, in works, an administration building, etc. 
[0029] Since the recognition approach of the stairway of the mobile of claim 3 
term was constituted so that said three-dimension location might be computed 



by determining corresponding points for every stage of a stairway, it can simplify 
a configuration further. 



DESCRIPTION OF DRAWINGS 
[Brief Description of the Drawings] 

[Drawing 1] It is the schematic diagram, showing the 2 pairs of mobile slack 
bipedal robot planned by the recognition approaches, such as a stairway of the 
mobile concerning this invention, and its control unit on the whole. 
[Drawing 2] It is the explanatory view of the image memory of the image sensors 
shown in drawing 1 . 

[Drawing 3] It is the explanation perspective view showing the stairway which the 
approach concerning this invention plans. 

[Drawing 4] It is the flow chart (whole PAD diagram) which shows the approach 
concerning this invention that the image-processing unit shown in drawing 1 
performs. 

[Drawing 5] It is the sub PAD diagram showing an extract of a white field with the 
subchart of the PAD diagram of drawing 4 . 

[Drawing 6] It is the explanatory view showing a subject-copy image at some 



explanatory views showing an extract of the white field of the drawing 5 PAD 
diagram. 

[Drawing 7] It is the explanatory view showing the binary-ized image similarly. 
[Drawing 8] It is the explanatory view showing an extract of the longest white line 
for every line similarly. 

[Drawing 9] It is the sub PAD diagram showing class distinction and the endpoint 
extract activity of a quadrilateral with the subchart of the PAD diagram of 
drawing 4 . 

[Drawing 10] It is the explanatory view showing the case where it is inclined and 
reflected at some explanatory views showing retrieval of the disappearance part 
in class distinction of the quadrilateral in the drawing 9 PAD diagram. 
[Drawing 11] It is the explanatory view showing interference of each stage 
similarly. 

[Drawing 12] It is the explanatory view showing the additional activity of a lack 
part similarly. 

[Drawing 13] It is the explanatory view showing retrieval of four endpoints in the 
class distinction activity of the drawing 9 PAD diagram. 

[Drawing 14] Top Right of the characteristic quantity similarly used by the class 
distinction activity It is the explanatory view showing the case where it is zero. 
[Drawing 15] It is the explanatory view showing the case where Top Left is zero 



similarly. 

[Drawing 16] It is the explanatory view showing the case where Bottom Right is 
zero similarly. 

[Drawing 17] It is Bottom Left similarly. It is the explanatory view showing the 
case where it is zero. 

[Drawing 18] It is the explanatory view showing the case where Max Up is zero 
similarly. 

[Drawing 19] It is the explanatory view showing the case where Max Down is 
zero similarly. 

[Drawing 20] It is the explanatory view showing the case where Min Up is zero 
similarly. 

[Drawing 21] It is the explanatory view showing the case where Min Down is zero 
similarly. 

[Drawing 22] It is Top Right similarly. It is the explanatory view showing the case 
where both Top Left is zero. 

[Drawing 23] It is the explanatory view showing the case where both Top Left 
and Min Up are zero similarly. 

[Drawing 24] It is the explanatory view showing a trapezoid similarly. 

[Drawing 25] It is the explanatory view showing a lower left upper right acute 

angle similarly. 



[Drawing 26] It is the explanatory view showing an upper left lower right acute 
angle similarly. 

[Drawing 27] It is the explanatory view showing a right acute angle similarly. 
[Drawing 28] It is the explanatory view showing a left acute angle similarly. 
[Drawing 29] It is the explanatory view showing the position coordinate of the 
endpoint used by the endpoint extract activity of the drawing 9 PAD diagram. 
[Drawing 30] It is the explanatory view showing the case of the right dip of the 
characteristic quantity used by the class distinction activity of the drawing 9 PAD 
diagram like drawing 14 . 

[Drawing 31] It is the explanatory view showing the case of left dip similarly. 
[Drawing 32] It is the explanatory view showing the matching activity of the 
quadrilateral of the drawing 4 PAD diagram. 

[Drawing 33] It is the explanatory view showing triangulation of the drawing 4 

PAD diagram. 

[Description of Notations] 

1 Leg Formula Mobile Robot (Mobile) 

24 Idiosoma 

26 Control Unit 

34 Plate 

36 Image Sensors 



38 Image-Processing Unit 
50 Stairway 

The top face of 50a stairways 
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